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A  stationary  stochastic  process  {yfc}  with  mean  %y  =  0 
satisfies  a  stochastic  difference  equation  if  there  exist  constants 

„  •  p 

Sq=1,  3^,  ...  ,  $r  such  that  {ufc}  defined  by 

k 

(1)  I  yt_r  =  ut’  t  =  ...  ,  "i,  o,  l,  ...  , 

r=0 

' _  •  ■  ,!  ■'  I 

consists  of  independently  identically  distributed  random  variables. 

The  process  {yfc}  is  stationary  and  yfc  is  independent  of  u 

ut+2’  ***  ^  and  only  if  roots  of  the  associated  polynomial  equation 

(2)  f  er  xp“r  =  o 

r=0  r 

are  less  than  1  in  absolute  value.  The  process  is  autoregressive 

2  2  2 

of  order  p.  We  assume  ^ufc  =  0  and  %  ufc  =  O  with  0  <  O  <  °°. 

Let  y^3  ...  ,  y^  be  T  successive  observations  on  the  process. 

To  estimate  the  coefficients  3-,,  ...  ,  3  one  can  solve  the  linear 

1  P 

equations 

(3)  c^bj  -  -c±,  i=l,  ...  .  P, 

where 

1  T-i 

(4)  ct  -  c_±  -  ?  yt+1  yt,  i=o,  l . . 

See,  for  example.  Section  5.4  of  T.  W.  Anderson  (1971).  We  assume  that 
there  are  at  least  p  different  nonzero  values  of  t  observed.  The 
purpose  of  this  note  is  to  show  that  the  solution  of  (3)  yields  coef¬ 
ficients  corresponding  to  a  stationary  process;  that  is,  the  roots  of 


1 


(5) 


The  equation  (7)  is  the  first  row  of 

T+p 

(8)  B  l  y 

~  t=l 

and  b'  is  the  first  row  of  B.  The  other  p-1  rows  of  B  constitute 
the  matrix  (-1  0) . 

Theorem  1.  The  matrix  B  defined  by  (8)  has  characteristic  roots 
less  than  1  in  absolute  value. 

Proof .  If  u  is  a  characteristic  vector  of  B  corresponding  to 
a  characteristic  root  X 


T+P  „ 
K  =  -  l  it 

t=i  1 
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(9) 


A4 

5*  I 


Zt  It 


-A  u’  I  yt 

t=i  ~  c 


Normalize  u  so  that 


T+p  _  T+p  _ 

1  =  u'  l  y  y '  u  =  -l  (u*  y  )  (u*  y  ) 

t=l  ~E  ~  .  t=l  ~  ~  ~  ~ 

T+P  _  T+p  _  _ 

=  u*  l  y^  y^_L  u  =  ^  (u'  yt_1)  (u*  yt_1> 


where  u  is  the  complex  conjugate  of  u.  Then  multiplication  of  (9) 


on  the  right  by  u  gives 


a  -  I  yt  yj-i  «  “ 

t=i  c  c  i 


T+p 

J1  (“’  ?t>  h-P 


By  the  Cauchy- Schwarz  Inequality  |\|  <_  1.  We  can  have  equality  only 
if  u'  y  =  u’  y  1 ,  t~l,  ...  ,  T+p,  which  is  impossible.  Q.E.D. 

Since  the  characteristic  roots  of  B  are  the  roots  of  (5),  the 
desired  result  has  been  proved.  [See  Section  5.4  of  T.  W.  Anderson 
(1971).] 

Theorem  2.  The  roots  of  (5),  where  b„ ,  .....  b  are  the  solu- 

-  -  -  ]_  p  - 

tion  to  (3),  are  less  than  1  in  absolute  value. 

The  result  can  be  extended  to  the  vector-valued  autoregressive 
process  {yfc}  satisfying 


„  Sr  h-r  "  V 


t  —  ...  ,  —1 ,  0,  1,  ...  , 


where  y^  and  ufc  are  q-component  vectors  and  ]3q  =  I,  ...  , 

are  q  x  q  matrices,  ^ut  =  0,  and  £  ut  ut  "  positive  definite 
and  finite.  The  analogue  of  (2)  is 
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(13) 


1  l  Pr  *p~rl  =  0. 

r=0  ~ 

We  observe  ...  ,  y  and  define 

1  T-i 

£i  =  £-i  =  T  t^1  ~t+i  £t*  1=0 5  1 . . 

Then  the  estimates  B, . B  are  the  solution  to 

~1  ~P 

(15)  ][  Bj  cj_  j  —  ”“cj  »  1=1>  •••  »  P  • 

'  j-i  J 

The  roots  of  (13)  with  B  replaced  by  B  ,  r=l . .  have  roots 

4-r  -r 

less  than  1  in  absolute  value. 
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